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ABSTRACT 

An investigation into uses of evaluative feedback in 
a graduate- level external-studies course in supervision is reported* 
Methods of presenting feedback are described, utility and clarity of 
feedback discussed, and the role of feedback in external and 
traditional instruction compared. Student assessment of the methods 
utility and the accuracy of instructors' comprehension of student 
communication (as perceived by students), and instructors' own 
assessments of their teaching are analyzed* Conclusions of both 
students and instructors are given, with recommendations for future 
feedback methods in external- studies courses* (SK) 
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SiTly last cummt. DvAA ChtmpatgeM Invited m to tMoh « ooors* idth 
his. It wi» to b» th» first->tlM offoring of a gr«da«te-l«Y»l extcnul- 
ttudios eoors* in supervision. Without knowing aneh about extemsl studies • 
I seeepted. Without knowing how to guarantee successful results* we taught. 

At the tiae, neither one of us had had enough experience with this 
■ode of instruction to feel truly self-assured in it. Neither one of us 
knew exaetly what was needed to nake it work wst effectively. Heither 
one of us knew idiat differences to expect fron the students, what thsy aight 
need, or how to provide that which we oonldnft identify. Ibe best option 
apparent to us was to try what we thought likely to be good praetiees and 
then to hasard an evaluation that night eventually ireseribe revisions. 

What follows is a report on the investigation into our uses of evaluative 
feedback during the first tern of this coursefs offering. Ihis paper will 
describe sone of our teaching habits throughout the tern and will present 
findings froB our evaluation concerning the presentation of feedback (to 
students), the utility of this feedback (to students), the accurate of the 
instructors* oonprehension of students* coaamnieations (as perceived toy 
students)* and some relative differences between this node and traditional 
graduate-level course work. FVurther. the instructors* assessnsnts of their 
own instruction (in teras of students* learnings) will be included. Tentative 
oonolusions and suggestions will be offered. 
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FRBSBITAXIOII OF FEEDBACK 



At this Mtoeiatlon's 197^^ aMtlng* Dt. WUlin G6ol«7 |r«8int«d a 
papw titled: Diaansloning Instractional Rpoc#8»es> Anong other points 
brought out in the paport Ik** (boley identified *^Stlmlu8<»*reepon8e«>*feedbeek^ 
ae one of the aott eritioel of clMsrooHi TtrieKLes in a study oondueted by 
the Stanford Research Institute* Ihe educational value of feedback ist 
of coursot undeniable to anyone irix> has been a student* That it oust be 
is dear* Gbw it mst be is not* 

Tn a recent conTersation vith Dr* Jaaes Holland* I nondered about "hov*^ 
I asked about the possibility of using the necessarily delajred sort of 
feedback Or* Gbaapagne and I had offered in our external instruction to create 
•iMSt-iMMdiate reinforcenent through oonfirvation* Was it possible that ve could 
do so by approziaatlng the situation in which the student had perfomed 
originally T I thought that our practice of using the students* ifords and 
examples night be able to recreate the thoughts that had detendned the vork 
and* therefore* offer something close to iasMdlaey in confimation* Not so* 
Or* Holland explained* It doesnH vork that vay* And anywiQr* ithat vas rjsal^ 
called for* he continued* vas the derelopaent of mterlals designed to offer 
imediate eonflffiaticn by theaselms'-^-^itbout reliance on an instructor* 
^But th£^ almost never happens*** he said* In so saying* Er* Holland justified 
the need for evaluative feedback* Almost no materials do offer immediate 
confirmation* Furthermore* almost no materials provide sufficient clarity* 
Qftm it is only the feedback from an instructor that establishes the context 
necessary for understandlng^as especially demonstrated during those frequent 
occasions when the answer can be neither nor *Vio*** 
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FMdbAok is laportant. Doth Br. OMURpAgne «nd I belleTed so at tha 
■tart of onr «xt«nua. c1m9 and do so still. Bscausa w» boU^rad foodback to 
b» li^rtant* «• daslgnsd oar Instruotion accordingly. 

Student aatorlals began to arriT« through th« nail after the first of 
the thre« class-interaction sessions. (These matefdals .wer« pages ea!>iilar 
reMved ftOB the text, with addiUonal pages supplied by thf> student «* 
necessary. Jbr each original set of papers, studentfe supplied one oopsr for 
our files. These w referred to throughout the tent when salting specific 
references and for evaluation purposes at the end of the tern.) The ft?at 
units were eraluated but were not graded. This was an effort to dewnstrate 
what would be expected without punishing the students for not knowing In 
the beginning. 

Ihrottihout the rest of the term, we received the work sheets as the students 
subidtted the«, when th^ chose and in the order they chose. Bath instructors 
read and evaluated the first aaterials received in an attempt to aake «iure 
that our individual choices for feedback were appropriate and in agreeasnt. 
Since it would not be possible for both instructors to continue to read all 
of the itudent Materials, we wanted to ensure thst our notions of feedback 
were ooapaUblo so that students would not be subjected to clashing opinions 
of their work or divergent InterpretaUons of the readings and units In the 
text. 

After esUbUshlng such agreeaent, we usually divided the aall— each 
getting half. The aall was also sorted In ouch a way as to guarantee that 
all students would receive responses fron both Instructors at different 
tlMS. (* did choose to present individual points of view to the students i 
we jtttt didn't want then to suffer eonfUctlng ones.) On receiving students* 
work, we tried to send out our responses within one week. At the outset. 
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Dt. Ch«p»ia« mrot. <mt hi. feedback by h«d while I tyi»d «Hi.. Aft«r 
;ta«t • .hDPt tin*. I itopp^l typing becwis. it etu*«d « d.l«y in r..po«li»f . 
Throuctout tte 15-i««k th« 17 ttadent. i»ho oo«pl.t«d the oottr.e (fw. 

the kZ BUAmU who rt«^ed It) received 301 pages of feedback on the 1066 paffes 
of .aterlal they ^bnitted. Of couree the student, ifho did not wmplete the 
course in the prescribed 15 n^k* did subsit .aterials and did, therefore, 
recelTO feedback. The total yolvmB of correspondence is considerably greater 
than the 1367 V*i^» wnUcned here. (Fbr nonbers of pages of feedback per 
student and pages of work per student, see Appendix A.) 

(M.B, the figores are for wnibers of pages written on. Hot aU were 
ccplot. pages of correspondence. SD«e of the work sheets fro. the text .haw 
«»ttl«g «re than Check «rk. in colons of choices. Sisdlarly, not all 
fallback cohered a full page. hu^r«»re, feedback wa. al«» jroTided for a«dio 
upas that were subidtted by so«» student, for specific section, of the 
OMTM vork*) 

lha way the feedback wa. written is, of course, equally a. im)ort«it a. 
the way in which it was returned. An exalnation of 45 pages of this feedback 
(which conprise the total feedback received by four of the students who 
co-pleted the course within the t-m) shows som Interesting-although not 

aceidsBtal— patterns . 

The separate pages of fe«lback are, al«».t without fail, addressed the 
individual student. This pracUce was a conscious effort to overoone the 
Wtable distance imposed on students and teachers of external studies. 
More tbMn h^f of the pieces of feedback include som personU^^ften 
aneodotal-note. Itore than half Include quesUons to the stuc^ent, question, 
that w^ int«Kled to be tak«> aerlously. And the phone call, and letter, 
received raa«Bt that often they w»re taken aerlouely. 
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ItM bulk of f«edljack f«m thes* 45 p»ge» wm broken donn into 
grots c«to«ones lAlch shoir that: -or. thtti hiOf proTid^J •ddiUon.l infor- 
Mtiont .or. th« !ulf off«r«l tono for. of spocific pr«iM/r.lnforc«wt 
for food nark In tho mdti .oro thM» ono-tJdrd Mdo tpodfio r«ooii^«Uon« 
for r«Ti.ioB or Ititw work; wro th« imlf Md« us. of th. opportunity to 
proTldo .ddiUonia instruction-ospocially cont«ttuaj «>re thw ono-third 
id«iUfi«d tpwlflc orlUciwij ai contanod at loMt ono for. of oralnation- 
•nd uwtlly not only that of a lettw grad.. (fbr m^s and catogorios of 
f««ft>adk, Appwdlx B.) Th«r. is no dear connoction bHnow grad. and 
th. a«>tmt of f^Klback. All ttudmit. racrtTad all of th. diffr«»t cafgoria. 
of faadbadk, at different ti«ea in the taw. 

Both inatmctor. were ad«untly oonrineed that mich thorough and irol«dwm. 
fe«lbMk im. of great i.portance. Eren though the mriting of mioh an ext-iaiT. 
Mwunt of felback r«iuired an approxiiute aTerage of 20 hour, each «eek 
(eo.bin«l ti«. for both inatructora). it na. felt that the effort «a. neoeaaary. 

«hlla certainly aelf-aerving. it i»uld, unfortunately, be leaa than 
candid to miggeat that no faux pas were oo-dtted in thi. atf.pt at personal 
feedback, There 1. one especially clear ...ry of a student who took Justifiable 
offenae at this lnstructor«s sarcasUc reaction to the repeated use of a 
earrently fashionable ter.. making, a. I did, the accuaation that thr iwrd «as 
■ore a rallying cry than a aeaniwgfUl adjectlTc. It is inportant to note, 
hww, that this is the only incident that is easily recalled. 

Italng the time of the courae, the iracUce of proTidlng extenslT. feedback 
«as supported by UtUe «>re th«» bias. Bit a particularly uaefva inreatt. 
gation by Er. Dorla Oow has yielded Talidation for our prejudice. 

Dr. Oow also haa prepi^red and taught an extemal-atudlea program at the 
Oniwaity of Uttaburgh. FtoUonlng her own instruction of the course, and 
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.iw following th. InstrueUon of the saim oour.a W ««th.r prof.«>r. 
Dr Cow ooll.ct«! unit rating shot. fro. both cUssos of stud«t. *• data 
for the fonutiv oTaluaUon of course nafrial.. Th... .h..t. (S.. iPP«>aix C 
for r.T..l .trikiBg diff.r«»cs in th. rating of th. •at.ria. 

at diff««at tiw.. a. taught W diff«r«t irof..«)r.. Fbr wMMmpU. th. 
total 7a»b.r of "V.ry Good- rating. r.tum«l at th. tiw of Dr. G«m«. 
inrtruotion i. 152; th. total nu«b.r of «V«t Ibor- ratings fto. th. bu^ 
cUss is .wo. In this oas.. abaolut. rating. po..ibl. (all ttud^t. 
,..po«di«g for aU unit.) for ^ cafgory ^ b. 805. fil«iTal«t «-b«r. 
of unit rating. r.tum.d at th. ti«. of th. ..oond prof..«»r.. in.truotion 
^27^ 16. r..p.ctiv.ly. i« absoluf for ^ catogory in this cas. 
ueaid aqual 5^0. 

Av, Dr. Gow r.i»rts (in r.,^«alim Dssiar. in<1 T»T.loT»wit Rroj.ct^ 
fl«»l fi.t»ort. F«I.r.l ft«J.ct no. O.904>B): 

It va. int.r..ting to not. th. dlff.rjnc^ "!i2'«.at.r 

r:njifrt.".sjis„-"c:ss5:rg,rp.^t«t. ^nt^otor 

tSt* "tSS"«SS;;inr-i?Jr.« or 1^. » of tb. 

oonsidar th«i. In r..pon.. to an obj.ctiT. r«Kiuiring xn. 
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•tod«nt to ^0Mn8trat« avarmass of tha inatmctional atratagiaa 
on irhloh tha prograa la baaadt" tha quattlon vaa not only ^Qf 
doing vhatf** in axaapla vaa (iTan* aa wall* **faj daflnlng tha 
ratlonala for aach*^* ^ 

And: 

Aa a raault of thia axparianoa in flald taating tha satariala* 
it vaa apparant that tha inatraetor^a aanoal mat atraaa faadhaok 
and mat aaphaaiaa tha oonfbsiona ifhieh can raanlt for atudanta 
attattptlng aalf^inatruotion for tha firat t^mm^ 

Or« Qcm ooneludaa that: 

• • • tha aaount of faadback nhioh sight ba accaptabla irhan 
atiidanta and inatruotor ara naating aaoh waak ia totally inauf fleiant 
whan tha atudant cannot raadily aak qtiaationa and racaiva 
anavara* 

It Mat ba grantad that thara axiata a poaaibility that tha diffaraacaa 
in ratinga ratamad by diffarant atudanta at diffarant tiaaa to diffarant 
inatniotora for tha aana aatariala ara aoaa fVmction of a Tariabla othar 
than faadback* Bacauaa tha diffarancaa ara ao dafinita» howeirart it aa«a 
likaly that thia Tariabla accounta for at laaat a aubatantial portion* 

Jkt ai^^ rata» our boat goaaaaa at tha worth of our faadback afforta~ 
avan with TalidaUon-^ia for nought if it ia not parcaiTad and aapportad by 
tha atodmta for ybou it waa mrittm* 

At tha laat of tha thraa claaa^intaraction saaaiona* tha inatruotora 
paaaad out to tha atudanta an araluation quaationna.'iira that vaa, to ba fillad 
oat and ratumad at tha atudanta* conTanianca* It vaa not apacifically 
raquaatad that atudanta sign tha quaationnairaa ao thara ia no vay to 
datandna tha axtant of axpariancaa rapraaantad in thair raaponaaa* Sona 
quaationnairaa nay vail haTa bean conplatad and ratumad by atudanta iriko 
vara* at that point* in ralativaly aarly atagaa of tha couraa vork* 
lionathalaaa* all of tha quaationnairaa vara raviavad and tha raaponaaa that 
appaarad vara oollactad* 

In anavaring quaationa about tha praaantation of tha faadback* tha 
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•ttidwts •sUbUtlMd MM •gMMimt in atUtnd*. Of 17 rMponMf, only on* 
b«ll«T«d that th« fo«d»Mick •appllwi wu not of appropriat* l«Bfth. Thoe* 
who Mpliod to tho question with aor* than on* word mad* tho following 
ooMMitai not eloart long anonih to om hvlpfali gavo strsRgth to th» 
eoarsot would lika ■ora; fallback axeallant, faiiMn*, ooncisa, insightAO.* 
length good. 

Mhon aakad if typing wotild havo i«prov*d th* faadbaok* all ratpond«ta 
aaid, "Mo." Sorprlaingly, four of tho 16 atudanta anawwring th* qaaaUon 
•xplainod that thay foond hand-wrltt«» faadback to ba noro "paraonal." 

fm atadanta baUarad that thair faadbaok had baan ratamad to th*« 
in a raaaonabla aaotint of tina, bat foor did not. In a tandnal ooMit, 
otto atadant oonplainad that it took y-k waaka to raoaiTa aoM rapliaa. 
Thia oaM aa a aarpriaa to both inatruetora bnt thara ia no arridanoa to 

diapnta tba eritioiaa. 

KLght atadanta baUarad that it would hava baan prafarrabla to auhait 
larger rather than anallar unite of work at a tiM. Seren other* felt 
that that waa not the ease. 
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omm AMI) aiRnr of rmBkO. 

Hm BMd for cXw, ttt«iW f#«&Mk is ebrte-t, to jwldo neh 
fo«Ib.dc i. «ot. Bd. i«obX« i. Mrtl-r —pUcatocS bj th. oUl|af <n-Uon., 
-ao» to •ho.t" •»! "UMlta to •too.T" tooh profottion doflnot its •« 
^p«.b«l«y «d tho.. of «. 1» -k. «. of tl*. "aecopUd" cowUU««/ 
d«oUtlon fr«ri«tly nm th. »l.lc of oonMIng tbo.. e«»t. OH. 1. 
« ..podLally i-rtii-nt proWL-i to •ducatow 1*0 «ro in th. biaslM.. of 
lnlti.tlnfth.wlBlU.t1. ftoth««or.. for fo^lbw!. -..f- to b. 
«.ftt. th.y It fr^ • ««l«rrt«rflng of th. iut«nU. «n i*ioh 
th.j .r. f.«!l«f b.ek l«fo»«Uo«. ind th.t r«pilr.. th.t th. orHln.1 
».t«l.l. b. olMT. md th.t oo^aoti.. th. fra.tr.tlng oycl. of oonMrton. 

lb hmo^ th. nrlUng ridU. of rtad^t. iwld not b. «..ftt. «» 
off« r««li.. ^ *ot b. po.abl.. AU thl. o« do 1. d..onb. 
th. .ffort. th.t «d. in tbi. oour.. «d oonToy th. r..oUon. of th. 

tt»d«DtS# 

Ih. .P.0HI0 ct.gon.. of f.*lb.ck h.T. b.« dl.e«..«i K^ootly. 
(S.. App«Nlix B.) Ifc.t r«ulft. to b. oonad«r«! 1. . .f-dfio .p|r«i.«l 
Of th. IndlTldua r..pons... (Fbr of lndl.ldo.1 tAoo.. of f.-b.ok^ 

t.k«i. a«ln. fro. th. 45 •U?«*dy B«ti«ed-.... top«dlx D.) 

A» «..in.Uon of th. f.«ib.ck .«t to .tadwt. .how. that th. 
f.«lb.ek 1. l«dlTld«ai.«l. th.t thl. .hoold b. «» 1. hwdly . -.jor 
,^a.Uon-H«tll it 1. r.Ul.*l that th«r. h«r. thoaghU of doling 
ottt orlUd f.«ib.ck fro. .t«idttdi««i eoUootton.. 

Th. f.«Ib«k 1. lnditld«m.«l in th. sm.. that .aoh pl««. .ddr..— 
a partioular Indl^duU. ««i«»Ung on a .p«Allo pl.c of «rk. CriUcl-. 

^ 12 
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prals*, addiUon«l instrueUon. •▼•luaUon, *gr««««nt, oont«ztu«l lafor- 
■aUon. cauUons, rMoaimdAilons, quetUon*. «nd personid r»oon«oUoii« 
•r« all dlr«ct«d «t »p«ciflc piecM from th« IndiYidutl stndwt** work, 
Dm ton* of all of tho foedbaok rafloots this specifleitar. It la 
tterottghly parsonal. Bacaua* both Inatrnetora ftOly raaUsad that thalr 
Mssac*!: war* Intandad for only ono paraon, it vaa eonpletely eenfortabl* 
for tha« to urita peraonal lottora, making na* of aharad infonaUon, 
aharad Attitndaa, obacanittaa, jokaa, aareaaa, word playa, epAnion, and 
•xpaotwl oonfidanUaUty as waa d*«Md appropri*t*. (Tha Tolwa of 
prlTata, raciprooal oo«nication supportad this aort of intiM<7*) 

Both inatructora aharad an anthuaiaatto faaling for tha ainoara 
ooMdtJMnt that waa da«>n8trat«l in « oonaidarabla portton of tha atadanta* 
work. It waa fait that tha inatrnetora* own peraonal cowitiwnt fostwrad 
aaoh raaotiona to « larga dagraa. Bot to b* aora, it ia, again, nacaaaaxy 
to rafar to tha atudanta for confi»ation, 

' .T*n atadwita baUarad that tha faadback halpad to clarlfj' tha axpaet- 
ationa of tha inatructora. Of tha two who did not agraa, ona azplainad 
that, ao far, (a)ha had only recaiTad ona placa of faadback *t tha ti«a 
(a)ha eo^aatad tha queaUonnaira. Other con^ta ware included, auch aax 
taaohara are Tory crittcal; feedback >ade work aora weaningftal. TifVf 
atudanta found the feedback easy to underatand; two did not. One replied, 
•Ttoat of the tii»" and another ananared, "Bot alwaya." Of 15 atudanta » 
raaponding, only one criticiaed the feedback aa being too general. Ihe 
14 others beUered that it waa neither necessary to naka tha faadback 
•ore specific nor .ore general. All 13 students raaponding to the 
<Itteation agreed that the feedback supplied waa relevant to tha«. 

In raaponding to questions concerning whether the feedback da»n- 

Er|c 13 
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•tr*t«d that th« Instructors understood the students* vorks, 10 said thst 
it had, one said that it had not, and one each replied, "Ibat of the tlse," 
""loaetlwsj * and "Questionable.*' Six students said that thay nonld be 
■ore personal in their oosMinioations if thsy took this type of eeurse— 
from these saae instructors— again. Elgjht believed that thaj wrald be 
neither leas nor aore personal. Mmo asked if the feedback had been 
sufficiently attentive to issues raised by the students in thsir i»rk, 
13 said that it had, nhile one did not feel that it had been consistently 
attentive. 

Ihe questionnaire also asked if there had been any tiMS uhan the 
students were aade to feel iU-at-ease by the instructors' feedback. Six 
atndents said, »*>." Seven others found that there had been such occasions. 
These studanU supplied the foUowing renarks: couldn't reply except by phonei 
ubm I aade an error nhich ni^t be renected in later units alrMdy oon- 
pletedt have trouble writing ny neaning; instructor labeled "fenlnisn" 
pseudo-chic jargon nhich has as nuch neaning as open education which the 
teaehsr didn't Ubel Jargon; yea, but aecepUble critidSB: yes, when the 
instructor said he couldn't read wy work; disagreed with coMents and 
oottldn't respond. 
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EHBRXAL AMD TRADITIOMAL IMSTRUCII08 

EbctenuX InstrucUon. m an isw., is i^^ing oonsidwabl. •ttwUon 
«t this tlM. It nould not, hoiiw«r, b» ussftd for this pspsr to •xtmA 
gmorslisstions about tho earrmnX oontwwsy. Ihls offort ulU only 
rtport tho stUtados of tho students and Instruetors fto. tho first offor- 
Ing of tho OhiTorslty of Pittsburgh's course, Qirriculu. and Suporfision 880. 

Mhan askod to oo»ent on tho naturo of external Instruction's possible 
difforeneos f*o« traditional InstrucUon, students «ade these coMts: 
■BTO individualised; «>re structured because of tmn«r .eeUngs, *oro tlM 
to think; r«jaires a lot of ti«e, requires real co«dt«nt fro. stud«»ts; 
«ch «>r. i»rk and no ii-diat—at tho shoulder-feedback; I need • tradi- 
ttonal oourse, tho «f rials mxt be clearer and the course «>ro structural, 
don.t h*Te the Talue of discussion; colder^can't roUto nith felloir stud«it., 
r«ruires «»re of st«d«»t; stud«.ts «ust be «»re self^sciplined; «ttem.l. 
rtudies is hardw-i -ore i«»rk and -ore indlviduaU.ed, students perciTod 
no differsnce, according to their responses. 

The next quesUon asked nhether students expected a difference in 
of fe«!back fW an extemal-studies course than f*o» a tradition^ 
class. Che student expected no differ«ice. Uie others who responded to this 
quesUon «si«r«l these ways: there has to be fe«iback in a tradiUonU 
cUss if jott use the professor; «>ro foedback is necessary (in exUmal 
studies); -re f-Jback was roclTod, but not as spontaneously; fe«iback 
should be indlTidualised, but not saying it i»asn«t; depends on the 
.tud«»t-I ne«l«l feedback; I expect very good feedback; yes, «»re writt«i 
f.«lb.ck; yes, the feedback is «,re direct but ther. is litUe ..auation; 
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fe«lb»ck Bttst b« wdtten; external studies require meh aore feedback; 
extemel-studias students get w>re personal feedback; expect acre feedback. 

Of 15 students, one believed that an average instructor does not need 
special skills to nanage an external-studies course. The other 14 respondents 
suggested these special skills: patiwce in reading assiements; skill 
to sake coMMnts construcUTO and not dautging; perception— l«»at does the 
student s^T Uhat does the student ■eant; Bust respond Beaningftally; 
drive to get feedback to students; anst be aore specific; yes— in structur- 
ing the pfograa to be self-instructive; clerical and ability to second- 
gQMs the meaning behind the nord; clearer-faster; ability to individuaU«e; 
cnrriculus design «nd clarity in feedback. 

lOne students believed th^ "got to know" their instructors, Usting 
feedback, class sessions, and phone caUs as the ways in which thfy developed 
rapport. Five others did not feel that they "got to know" the instructors. 

It is interesting that the general tone of cedents- fron the students- 
is so clearly supported by the individual atUtudes of both of the instructors. 

The instructors* worst critidsm of this particular external-studies 
offering was that it required so much tine. As has been «entioned before, 
writing what was considered to be appropriate feedback required at least 
20 hours each week~^n the average. This ti«e is in addiUon to the hours 
of planning for each class session. These planning sessions were probably 
longer than average Uso, since there was so «ch aaterial proTided by 
the students illuidnating the issues itoich needed attention. 

In fact, an interview of both instructors reveUed the beUef that 
external instruction is generally .ore difficult to teach than traditional 
instrucUon. Fbr those teachers who enjoy the inediate reactions of 
•tttdents, this node poses a problsaix such pleasures are not siailarly 
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•TidUML.. i. th. .t«d«t. .ad, th.r. is no 1— diaf f.«lb.ek. Ihi. 
probl- iMd. directly to mother. f«ib*ek that is «ippU«l «.t 
stand by iflf . AU cont«tual infr«.co. that sdght othends. i-diaf 
f««Ibaok mat ba caralUly mdttsn hy the inatructorsj they ha^ nothing 
to rely oa hat i*at they olearly aiflf. This Uok of «ipport inait. thiit aU 
iaatwcUon^in the nateriala and in the feedback-be olear enoa.^ for 
Madera to be able to imderstand the first tii». lAthout the ad of 
queaUon. or other eUboraUon. BcUmal instruction require, planning 
that i. co«a.tently «»re csref^ th«» that by traditional oourae 

«ork. 

n^eae restraints, the instructor. beUer.. i-po- the necessity of 
eartain apecial akiUs; skiUs ^ery oft«. the s«ie as those id«rtified by 
the atud-ita. Teacher, of external instruction «st be able to lodt. idth 
«cceptional clarity, "n^oy «.t <!«ickly and clearly reveal their oi« 
«paeUtion. so that it i. possible for students to «eet th«a. Ih^ m^t 
ottm orercone the desire to criUci.e irtiat a .tud«»t has written ^ it 

po..ible that that i. not what the atudent .e«t . They mat be able to 
«rtte feedback that focu.es on what the students neant in a way that c«i 
be u.efta to the (individual) student. And, of course, they mat minUr 
the nece..ary aeUHJiadplin. to actually ait d«m with etudent.. -laterial., 
read thi, consider the., evaluate the., diagnose their weakneaaes, and write. 

Daapite all of theae pertinent and very real criticise, however, 
both instructors beUeve that there i. no infon^tion-and not all that 
^ .kill.-that c««ot be t«,ght in thi. «>d. if all of the neceaaiUe. 
are r..pect.d. 3« hi. interview, Lr. Q«.p.gn. said, "I thiAk anything I 
teach in a tradiUonal aetUng I c«» teach in external studies." Both 
inrtructor. beUeve that the performance of the students in thi. com>.. 
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^ .t l.Mt good the perfoHMnce that 1» to b. fouM in tr.diUon.1 
cU»..: lh« 8r.d.. -pned th* .tud«.U in this eUss i«p6 ftoraWy 
co.p««hl. to cUsBToo. ln.tPttcUon. t« though th. .t«dtfd. 
haT. highn- Ihor. wa. T« filing that .xt««U rt«di.» «y 
be wpTlop to tha tpadiUonal .oda bacausa. Inea tha studanf Ta not 
.no«d tha prlTilog. of sitting quietly in tha back of cUs.m. .t«d«t. 
«rk hartT. Rirtha«ora. tha toIu- of oorrospondanea pro^da. a cla«r«r 
undaratviding of tha atudant.. progpo.s «k1 n.«l». iMch allow, for wor. 
diagnortic faohing. -king tha intruetor work h«rdar. Of cour... .g^n. 

bac«».. oo-inicatton i. t.ritta«. instructor. «d .t»d«»t. mst b. 

cl«*er in what thay ^•'s than i. n-c.-T in classroom whsra both 

haTa th. opportunity to ask quaaUons i^adiataly. 

ai of tha afora^mtionad condition. artabU.h a .ituaUon of 

l«tt^duaU..d in.t,uction^«hich take. «>r. ti... ^haa. condition, also, 
fctar a .ituaUon in which grading i. .asi-r bacauaa thar. «ra 

.0 w Pioca. of work thin contribute to a f^r evaluation. 
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OOllCLDSIOliS 

On the lAole, studtnts beUered that «ct«m«l in.truction .htmW 
pro^d. . gr-t del of cl..rly «ltt«. p.«ona. indl^du^l.td. .peoifio 
f.«Ib*ek - «l«ickly M po-lbX.. Th. f.«lb*ck .hoTild not b. OT^Mjr h«r«h. 
Th«y b.UT.d that an arerag. instructor irtK» going to taach an 
«U«al ooura. iiould n.«! tha following .kill. «k! ablllU«i» paU«tc, 
darlty In ifltlng, «^flcl«t ..lfHtt.clpll«. to quickly araluaf and raturn 
papar., clarlcal, reading between the line., IndlvlduallaaUon; currlculu. 
dMlgn* 

tl«t tJ»T "Pt f kn»» ««lr ln.tr.ctor. «i «»t thi. «« «»ir l.p.rt«t. 
th., rtlU frtt th.t th. Up.rt«t ,w.rtmdtl.. for »i.t«t b.t»«. rt»5«t. 

t«.h«. b. «d. in . <— 

„ f.ll.«. «J0,«1 '•"•^ continuing, n» 

pl„ty of «r., ..tl.fylng, unit, too long «<. ln«l«a. «»rf..lng, .bouM 

.pproT. of oontrmct., cour.. «. off«*J .t . ^ 

.gan. th. in.truotor.> oo-»nt. «. «rr .Hdl". I>»T 
p.rh.p. «.t -..dnctlr « in on. of th. .tud«.t.. ««rk.= 

A lot ot nork but I wijojred It. 

art««a ln.tr«ctlon 1. not ..«.. b7 th... in.t,..tor.. « . po.1«» 
^-«.t for tr.dlU«»l inotruotlon. It «uld. .t lout In on. 
b. . poor ropUo—t b.o«... of th. tU. ln«l«d. «ot Ul tud-t. 
for. of l.«nl«g. 

«U«t- »a ..U^Ldplln- ^ -doling to «P«l-«t. th. tr-ltton.1 
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ooplng «^h«d«. donH nork. a»t «»eh dlffr^ces do not in «.y wjr 

«nd.ndn. of th. accept^i norm, of in.traeUo«. Whan -k^l if h. 

fit «. though h. h«l gotton to know hi. .xf «a.«tadio. stad«ts. 

Dr. Ch«PMn. ropliod. -I know thoir «lnd. • groater percwifg. bttwr. 

I don't know thoir faoo. but I know how thoy think." 

Q-rly th.ro .r. r.^ pr..wr.s on « «tt.r«.l in.tn»ctor with whioh 
. or • WO.W in front of • bl.okbo.rtl n.T«r«.«! rookon. a.t th. 
intruotor.. «p.ri«»oo with Oarriculu. «d ^.p-rrioion 880 «gg..t. that 
«»oh r.okoning «y .t«- th- in good .t..d. Th. d.«nd that .xt.m.1 
inrtruoUon i«po..s on . t..oh.r to «, ol.«rly oonooptu^i... org«i,.. 
pr.p.r.. ^ «-n t..oh «»oh a Urg. body of infor-ation/.kill. o« ha., 
no mjtoward .ff.ct on later porformwic. 
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BEOOMMQiDAnONS 

1. ficUmal-ttttdlM ootirsei ihould nwr be ritmi «• oo»t-ootting 

2. BcUnul oours«« should h» off«r«J to «xpl«in tho pwrticular 
■MMgMMnt sklU* that are r^iuirad by •xttrnal courte*. 

3. Sam ftttwUon should be glTWi to revising the work load of 
professors nho offer exUnul-studies courses because these courses can 

daaand aere tlM. 

U. AU feedback should be IndiTiduaUsed. 

5. All feedback should be extensive. 

6. All feedback should be personal. 

7. Hand-nritten feedback is acceptable. 

8. Efforts should be .ade to evaluate the idea of offering feedback 
in less ti.e.co««uilng ways. It «ar be usefta to offer feedback on audio 
tapes nhich can .ore easily carry som of the nuances of our Mssages. as 
through vocal but not verbal cues. Tape requires less tia» than writing as well. 

9. Instructors should sake use of feedback as a vehicle for farther, 

Individualited instruction. 

10. AU feedback should be returned as quickly as possible. 

11. It would aost likely be usefW. to propose student clusters so 
that students can «eet to share ideas. This could offer peer feedback. 

12. Ebctemal instructors «ust be avaiUble to students in other ways 
than throu^ written feedback. 
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APIBIDIX k 



Student 


Pft|^8 of feedmek 


Pages of stu 


tmm 


14 




Xm 


15 






29 


101 


four 


11 


Or 




o 

8 




fix 


20 










•ight 


16 




nln« 


12 




t#n 


19 


o^ 




15 


39 




19 


61 


thirtMn 


21 




foortMn 


15 


38 


fiftMn 


20 


7^* 


sixteen 


22 


105 


serefiteeii 


13 


3^ 



*5* 
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(kt«cori«» of FMdbaok 

Caution 

Br«ln«tion 

Infonutlon 

lAstrttotion 

Qiostion 

Rtinfor c wM ft t 

Sareani 

^elfie Qrltiolm 
^poolfio RvooBMndatlon 



Ifcimbw of Ihstane— 

3 

^5 
28 
20 
22 
3k 
Z 

17 
18 



23 
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0 
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APFBiDIZ C 

(T«k«n from Dr. Iteri* Gom's Ottrrlcttlm Patian Dwr^loffwnt BPoj«ct. 
HLnal R>port, Maral fro^mdt no. 0-904>b) 

B>pr«»w>t>Uir» Ifait Ratisa Sh— t for lintruetor Qrw 

Voiy Vory 
Good Good knrtn Ibor !bor 

U Hm aubjoot Mttor rolmraney 

to jofor own Intorosts (pro- ^5 7 

fossional or othondso) 

2. Iho eUrlty of objootivo* 5 7 5 

3. Iho dogroo to irtdch tho objoo- 
tiTo« and ■atorials prorido 

tho Information nooossary to 2 6 5 1 

aoooBpUah tho unit objeo- 

Uto« 



Ik Iho Intorost valuo of tho 
roadlngs 

5^ Iho aasiatanoo of soil- 
•corod toats to aolf 
•valuation 



6. Iho inatraeUonal Taluo of 
tho oxorolses (if appllcablo 
to thla unit) 



7l Iho inatruotional Taluo of 
tho atndy gaido(s) 



10 



24 
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ItowfuUUT* Hhit Rating S>wt for Ihitmetor IWo 



V«ry V«Ty 
Good Good AfTW ftor R^r 



1. Iho tablet Mttor roloranor 
to joor OMR Intorosts (pro- 
fotoiOMl or othonrlso) 



2. Iho elaritjr of obJoetlTOs 



Iho dogrwE to nhioli tho ob joo- 
tivos and Mttoriols prorldo 
tho iafonutlon nooossorjr to 
aoooaplioh tho lanit obji 
tivof 
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4. Iho intoron Tolno of tho 
roodlngo 



5« Tho oasistaneo of solf- 
soorod toots to self 
OTolttotion 



tho Inotruotionol toIuo of 
tho onreisos (if applicablo 
to this tmit) 



% Iho instraotionaX toIuo or 
tho stndljr caido(s) 
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APFnm D 

(M.B. IhM* •wplas of fMdbaek h*T« bMn typsd for this papMr; origiMlly 
•U vw* lund-ialtt«).) 



!• OMtpfttibillty will h*T« to b* only on* of th* critorla. A balane* 
of skilla i« alao noeossary. 

2. Urn dopmds on training and/or ability to bo hmoatly oenftrantlng 
to got oat Iscttos rathor than aurfaoo agro«Mnt. In aost toaM mrkod 
with* oar •ffootlTanoss grow to roally antonoaous stagos for about a yoar, 
thm« onloas «o doliboratoly sought othor aroas to work on. wa roaalnod 
ooafortablo at that atago bnt gradually just know oach othor 'a q[ulrk« and 
icoblaa aroas. Iho throo yoara so«bs too long a tlao to m. Vd guoaa if 
wo ««it throug)! loadorship training for a wook or two togothor wo oonld 
rapidly aooolorato thia offoctlTonoaa. 

3. Or triviality, but if tho group la tvuly aplit, OTor prograa, than 
it*s boat to find it our oarly and olthor change th«B or boto thM out. 

k, iny aaapling will bias rotiulta. Ton aust simply daoido whleh biasos 
you wish to liTo with and which onas you want to know about. 

5. intonoay 1* always rolatlTo and oontraeta nay raiso tho rolatiiro 
loTol dop«ding on how thay ar« drawn and tho proeoases usod in drawing th«8. 

6. Tou'wo got tho proeeaa definod in Ita real pnrposos. 

7. tfpB aro not noeoaaarily puaoolod by oraluation if it is not aoon 
as an att«Bpt to proro failuro, but rathor as an attempt to dorolep auoeoaa 
fyirthor. I knew thia is idoalistie, but, basod on our oraluation of thia 
first torn oonrso, I as rowriting wboXo sections to iaprove then. Z don't 
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f««l bidly At aU. I r«eo0aic« that thagr will get b«tt«r thm th*lr pr—mt 
good st«t« to m« at Nlrvaxut* 

<'3« Ioa*T« hit th« Issues* 

RmUj a food analyst* 

Grada 
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1* W go into this araa in groatar detail in a later unit (Kappa) 
ifhieh will be ready for FaU teni, but you hava used and applied the ideas 
thoaghtAiUy* The essential idea is the eentrality of plvming based 
on foals* and the repeated training* You expreas that idea* 

I(d integrate the one-to-one superriaion aore oarefttlly with the 
in-serviee developasnt effort* ill teaohers need soae one-to-one* 
9am for reaediation* sons for reinforeenent, and sone for extsnded 
■aatery* 

SLgnature 
Grade 

Saiple Ihree 
Nsae 

Jn none of the three role grids is there a "MB*ber«s Response" expressed 
in terms of behavior* It was intended that this heading denote a pLeoa of 
action parfoHMd in response to the threatening change* Mdle your deserip- 
tion of the aMberts responsive aood nay be wholly accurate, it is less 
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rmOlng tlu« forecasted action. FtarUiw«>re, actton Is fsr sssler to 
i>Mct to than aro goneralisad saotlons* 

2. Iss, that is ons lnt«»t of tbs Mcmreise. At the saM tiae, it 
is hopwi that, by charting the actlviUes. interacUons, nonw. and sen- 
tiaanU, it wiU beooM easier to decipher patterns of the persons/perMnaUUes 

with nhM jon work. 

3d. Wiat win be the ehildts reacUon to perceiirlng your pltyt 

mat are «»«~^ **** ^* **** ^»»«^«* 

that has a stnmg effect on the stwlentsl (The interactions, seotiasnU, 
aotlTiUes. and noiM are intended to be those of the teachers jou «i^ 
•apervise. fbr the Ment. excl«le the children-except as reaotants to 

teacher behaviors.) 

m have chosen not to grade this exercise in an atts.pt to give as 
«ich direction as possible, hoping to »xi^se the probability of success. 

Signature 



d. Ihis is a good su»ary. It tabuUtes information nithout polluting 

it nith inferences. 

e. Second stateiwnt is iwrthnhile but the first hinges on the value 

judgsMnt of relative efficient, 
f • Good inferences. 

g. ftue. but that's not the goal of the dassroos (hopefully) and 
these Uidts are Just sonething i»e have to nork vith. 
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b* Dds observation tool does not yield infoxmtlon about interaction* 
It only qfoantifies physical pXacenent* 

e* It is iaportant to realise the strict confines of the data oolleeted# 

system 3 

3# Good suBsry* 

Ihe use of these obserration tools is quite good* It is etiU neoessaryt 
ho«STer» to deal iiith all of their lisitationst realising that hard 
data is usually narrov data* 



Grade 

Signature 



